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Optimal  Detection  Search 


Joseph  B.  Kadane  and  Herbert  A.  Simon 


This  paper  considers  and  unifies  two  search  problems 
which  have  been  extensively  discussed.  A class  of  sequential 
problems  is  proposed  that  includes  both.  A theorem  is  proved, 
under  arbitrary  partial  ordering  constraints,  characterizing  a 
strategy  to  minimize  the  expected  cost  of  a successful  search. 

The  main  tool  is  a set  of  functional  equations  in  strategy  space. 
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of  the  Or  f ice  of  the  Secretary  of  Defense  ( P4A620-7 ,5-0-007^)  which 
is  monitored  by  the  Air  Force  Office  of  Scientific  Research. 


1.  Two  Important  Search  Problems 

The  first  search  problem  considers  an  object  hidden  in 
the  kth  of  n boxes  with  probability  pR.  A search  strategy 
for  finding  it  is  a permutation  of  a subset  of  the  first  n integers 
saying  what  to  do  next  if  the  object  has  not  yet  been  found.  Thus 
(9,2,2,...)  is  interpreted  t.o  mean  that  box  9 is  to  be  searched  first; 
if  the  object  is  not  found  then  box  2 is  searched,  etc.  In  this 
section  we  consider  the  simplified  model  in  which  a search  of  a box 
containing  the  object  is  sure  to  be  successful,  although  this 
assumption  is  later  relaxed.  A search  of  box  k costs  if  it  is 

unsuccessful  and  x^  if  it  is  successful. 

Thereare  at  least  two  kinds  of  such  searches.  In  a detection 
search,  the  goal  is  tc  find  an  object  in  some  search  of  some  box.  In 
a whereabouts  search,  the  goal  is  to  state  correctly  at  the  end  of 
a search  which  box  contains  an  object.  This  can  be  accomplished  either 
by  finding  an  object  in  the  search,  as  in  the  detection  case,  or, 
alternatively  by  guessing  correctly  at  the  end  of  an  unsuccessful 
search  which  box  contains  an  object.  See  Kadane  (1971)  for  a 
treatment  of  optimal  whereabouts  search. 

In  this  paper,  the  first  search  problem  is  to  determine  a search 
strategy  that  includes  each  of  the  boxes  and  minimizes  the  expected 
cost  of  a detection  search.  An  earlier  paper  (Kadane  (1968)),  deals 
with  maximizing  the  probability  of  a successful  detection  search 
spending  no  more  than  some  budget  P (when  x..  for  all  k). 
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Let.  o.  ( 1=1,2)  be  any  two  disjoint  strategies.  Tnen  0 = °ic2 
is  a strategy  which  looks  first  at  tile  boxes  specified  by  , 
in  the  order  spec '.Tied  by  , and  then  at  the  boxes  specified  by  a^, 
In  trie  order  specified  by  o.,,  until  the  object  is  found  or  o is 

C. 

* 

exhausted.  Also  let  o._  be  the  strategy  consist inp  of  a search  at 
box  k only. 

For  any  strategy  a,  let  X(a)  be  the  expected  ccst  of  a, 
p(o)  be  the  probability  that  o is  successful  and  C(o)  be  the 
cost  of  o if  o is  unsuccessful.  Tnen  we  have  the  initial  conditions 


(1-1) 


xU-o 


C(0j 


pKxk  + d -iv)c 


k^k 


= c, 


^k>  - Pk 


and  the  recurrence  relations 


X(o1o2)  X ( o . ) + X(  Op)  - F(o3)C(op) 


(1.2) 


0(0^0^)  - C(o.j)  + C ( o ) 
P(o1c2)  = I’( o - ) -i  t(a?) 


The  first  equation  in  (1.2)  arises  because  X(o^)  +X(o0)  is 
the  cost  of  going,  ahead  with  o.  oven  If  the  object  was  found  using 


cn  . The  probability  of  its  lie  i nr,  found  i n o. 


1' ( o 1 ) and  if 


it  was  it  is  sure  not  t.o  bo  found  in  c..,  so  C(o0)  is  the  appropriate 


cost. 


For  consistency,  if  A is  the  empty  strategy,  define 


(lo)  C ( A ) =■  3(A)  =•  X(  A ) = C 

Using  tnoRi-  definitions,  C,  X,  and  V are  associative  and  C and 
P are  commutative.  Problems  of  this  type  are  considered  by 
Bellman  (1957))  Black  (1965),  Blackwell  (n.d. , see  Matula  (1964)), 
Denby  (1967),  Greenberg  (1964),  Kadane  (1968),  Matula  (1964),  and 
Staroverov  (1965),  among  others. 

In  the  second  search  problem  considered  here,  the  event 
that  an  object  is  hidden  in  the  kth  of  n boxes  again  has 
probability  p^,  but  now  is  Independent  of  Ek/(k^k/), 

where  in  the  first  problem  it  was  disjoint.  Again  a strategy,  0 is 
a permutation  of  a subset  of  the  first  n integers  specifying  the 
order  i.n  which  the  boxes  are  attempted  until  an  object  is  found  or  o 
is  exhausted.  Again  there  is  a cost  for  an  unsuccessful  search 

of  box  k,  and  a cost  xfc  for  a successful  one,  and  once  again  the 
problem  is  to  find  a search  strategy  o that  includes  all  boxes 
and  minimizes  the  expected  cost  of  the  search. 

For  any  strategy  0,  let  V(o)  be  the  expected  cost  of 
using  0 and  S(o)  be  the  probability  that  the  strategy 
is  not  successful  in  finding  the  object.  Then  we  have  the  initial 
conditions 

( V(°k)  1 Pkxk  1 -Pk>ck 
3[0k)  ~ 1 " pk 


(1.4) 


4. 


and  the  recurrence  relations 

iVji-yj)  =■  v(o±)  + s(o1)v(oi,) 

(1-5)  ] 

S(o3o2)  --  3(o1)S(o2) 

For  consistency,  it*  A is  the  empty  strategy,  define 
(1.6)  V( A ) = 0,  S(A)  = 1. 

Problems  of  this  type  are  considered  by  Bellman  (1967),  Dean  (1966), 
Garey  (197.2),  Joyce  (1971),  Kadaruo  (19^9).-  Mitten  (i960),  Simon  and 
Kadane  (1975),  and  Sweat  (1970). 
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2.  A Convenient  Class  of  Problems  Embracing  Both  Search  Problems 


This  section  owes  a large,  but  not  transparent,  debt  to 

the  paper  of  Rau  (1971).  The  class  of  problems  proposed  below  is 

a proper  subset  of  the  class  proposed  by  Rau;  these  relationships 

are  not  pursued  in  this  paper.  Suppose  that  three  functions  f,  F 

* 

and  G are  defined  on  strategies  consisting  of  a single  search 

of  box  k.  Suppose  also  that  f,  F and  G are  extended  to 
arbitrary  strategies  by  the  recurrence  relations 

(2.1)  F(c1o2)  = F(o1)  + F(o2)  + G(o1)f(o2) 

(2.2)  f(o1o2)  = f(o1)  + fl  + mG(o1) ]f(o2) 

(2.3)  Gtc^cig)  = G(o1)  + [1  + mG(o1)]G(o2) 

where  m is  a fixed  number.  For  an  empty  strategy  A,  we  take 


i 


■ ti 


(2.4)  F( A ) = f ( A ) = G(A)  = 0 

First  we  estaolish  a basic  theorem  about  the  system  2.1-3: 

Theorem  1 

With  the  above  definitions,  F,  F and  G are  defined  consistently 
on  strings  of  arbitrary  length.  In  particular 

(2.5)  F((ab)c)  = F( a( be) ) 

(2.6)  f((ab)c)  = f (a(  be) ) 

(2.7)  G( (ab)c)  = G( a( be ) ) 


; 


% « 


6. 


Proof: 

F((ab)c)  = F{ ab)  + F(c)  + G(ab)f(c) 

= F( a)  + F(b)  + G( a) f( b)  + F(c)  + f(c) (G(a)  + G(b) + mG(a)G(b) ] 
F( a( be) ) = F(a)  + F(bc)  + G(a)r(bc) 

= F(a)  + F(b)  + F(c)  + G(b)f(c)  + G( a)  [ f( b)  + [1  + mG( b)  ] i“(  c ) ] 
thus  F((ab)c)  = F(a(bc)),  proving  (2.5). 

The  proois  oi  (2.6)  and  (2.7)  are  similar,  and  are  therefore 
omitted. 

QED 

Next  we  establish  that  the  two  search  problems  of 
section  1 are  special  cases  of  the  system  2.1-3. 

Theorem  2 

(a)  When  m = 0,  associating  f with  -C,  G with  V, 

and  F with  X,  the  system  (2.1-3)  yields  the 
recurrence  relations  (1-2). 

(b)  When  m=-l,  associating  F and  -f  with  V, 

and  G with  1-S  yields  a consistent  set  of  recurrence 
relations  identical  with  (1.5). 

Proof; 

(a)  Let  m = 0,  and  make  the  substitutions  indicated. 

(1.2)  is  immediate. 

(b)  Let  m~-l,  and  consider  (2.3): 

1-S(o1o2)  = l-S(o1)  + S(o1)[l  - S(o2)] 

= 1 - S(o1)S(o2). 


7- 


Now  the  second  equation  of  (1.5)  is  immediate. 

Next  consider  (2.1): 

V(a1o2)  = V(o1)  i V(o2)  - G(o1)V(o2) 

« V(0l)  + S(o1)V(a2) 

which  reproduces  the  first  equation  of  (1.5) 

Finally,  consider  (2.2): 

- V(o1a2)  = -V(o±)  - S(a1)V(a2) 
which  again  reproduces  the  first  equation  of  (1.5). 

This  shows  that  the  substitutions  yield  a consistent  set 
of  equations  identical  with  (1.5). 

*}ED. 

The  fact  that  the  first  equation  of  (1.5)  has  two 
(identical)  generalizations  in  (2.1)  and  (2.2)  causes  no  problem 
in  the  sequel. 

Thus  the  system  (2.1)  to  (2.;)  is  a class  of  sequential 
problems  including  both  search  problems  proposed  in  section  1. 


TWVtV 
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3:  Constraints 


8. 


Reconsider  the  first  search  problem  of  section  1 where 
now  there  is  a probability  a.  . of  overlooking  the  object  in 

J i 

the  jth  search  of  box  k given  that  it  is  in  box  k and  has 
not  been  found  before  the  jth  search  of  box  k.  Then  the  un- 
conditional probability  p^  ^ that  the  jth  search  of  box  k is 
successful  (if  it  is  in  the  search  strategy)  satisfies 


(}■!)  Pj,k  - Pk(1  -aJ,k>  " “j',*' 

Hj'<j 

Additionally  the  jth  search  of  box  k can  be  supposed  to 

cost  some  amount  c,  . if  it  is  unsuccessful  and  x.  . if  it  is 

J 9 ••  J f ^ 

successful.  The  notation  can  be  simplified  by  denoting  the  jth 
search  of  box  k by  a single  index,  say  i.  Thus  is  the  prob- 
ability of  success,  the  cost  if  unsuccessful  ana  the  cost  if 

successful,  of  some  search.  If  the  object  is  found  in  uhe  jth  search 
of  box  k,  it  is  found  in  no  other  search  of  any  box.  Hence 

the  events  Ej  k that  the  object  is  found  in  the  jth  search  of 

box  k are  disjoint.  In  effect  this  observation  allows  a.  . = 0 

J J ^ 

without  loss  of  generality,  at  the  cost  of  introducing  a constraint 
on  the  optimal  strategy.  A strategy  is  called  feasible  if  the  jth 
search  of  box  k is  preceeded  by  the  (j  -l)st  search  of  box  k 
for  every  k and  every  j >1.  Clearly  feasible  strategies  are 
the  only  ones  which  make  sense. 


Constraints  of  this  type  are  called  "parallel"  because 
they  can  be  graphcu  as  n parallel  lines,  one  for  each  box, 
indicating  that  the  jth  search  of  box  k must  be  preceeded  by 
the  j-lst  of  box  k and  must  precede  the  (J  + l)st  search  of 

box  k. 

A similar  generalization  of  the  second  problem  would  have 

the  jth  search  of  box  k cost  c,  . if  unsuccessful,  x.  . if 

successful,  and  have  probability  p . . of  success.  In  order  for  this 

0 > K 

to  be  a valid  generalization  of  the  second  problem,  the  event  E.  . 

o 3 * 

must  be  independent  of  Ej • provided  (j,k)  / (j',k').  Again  only 

feasible  strategies  are  interesting.  See  Kadane  (1969)  for  9-  discussion. 

More  generally,  suppose  S is  a set  of  searches  and  C is 

a set  of  constraints,  a sublet  of  S x S.  Thus  if  c=  (s^s^)  e C, 

then  search  s^  must  be  conducted  before  search  s^.  The  pair  (S,C) 

form  a graph.  The  transitive  closure  C of  C is  the  subset  of 

SxS  such  that  (s^,s  ) € C iff  there  exist  s^Sg,...^  such  that 

(s^s^j)  e C,  (s-p.s^)  e C, . . . . Thus  (S,C  ) is  again  a graph,  and 

% 

has  all  the  constraints  implied  by  C and  transitivity.  If 
* 

(s^.Sg)  € C then  s^  is  a predecessor  of  and  is  a 

successor  of  s-  . 

— A 

We  now  restrict  the  discussion  to  graphs  such  that,  if 
(s^,s)  € C , there  is  a finite  sequence  ( si» • • • , sr, s)  such  that 
(sj_Js2)  € C>(s2»s^)  € '-»•••,  (sr,  s)  e C.  Notice  that  in  the  case  of 
parallel  constraints  above  this  restriction  Is  satisfied.  A case 
where  it  would  not  be  satisfied  is  where  all  searches  cf  box  1 had 
to  be  completed  before  any  searches  of  box  2 could  be  undertaken. 


10. 


^ith  this  restriction,  if  is  a predecessor  of  Sgj  and  no 

other  predecessor  of  s0  is  a successor  of  s1  then  sx  is  an 
immediate  predecessor  of  s^  and  is  an  immediate  successor  of  s^. 

The  immediate  graph  C~  is  formed  by  (s^.s.-,)  e C “if  s1  is  an 
immediate  successor  of  s^. 

The  case  of  parallel  constraints  is  then  seer,  to  satisfy 
the  restriction  that  every  search  has  no  more  than  one  immediate 
predecessor  and  no  more  than  one  immediate  successor. 

A cycle  is  a sequence  of  arcs 

u = (ul»  • ’ • 5 uq ) 

such  that 

(1)  each  arc  u^;  1 < k < q,  has  one  endpoint  in  common  with  u^  ^ 
and  the  other  endpoint  in  common  with  uk+1 . 

(2)  the  same  arc  does  not  appear  twice 

(3)  the  endpoint  u^  does  net  share  with  u^  is  the  same  as  the 

endpoint  u does  not  share  with  u . . 

1 q q-J- 

A chain  satisfies  the  first  condition  above  only.  Not-  • mat  in  a 

cycle  the  endpoint  uk  shares  with  need  not  b . successor 

in  u^.  Thus  ( s1 , s^)  ( s , , ~2 ) ( s^,  s^ ) is  a cycle. 

A connected  grai  h is  a graph  wlilch  contains,  for  every 

two  nodes  x and  y,  a chain  from  x to  y.  Since  the  relation, 

x=y  or  there  is  a chain  from  x to  y,  is  an  equivalence  relation, 

the  equivalence  classes  divide  3 into  connected  components.  Finally 

a tree  is  a connected  graph  without  cycles,  and  a forest  is  a graph 

without  cycles,  i.e.,  a graph  whose  connected  components  are  trees. 
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A forest  is  thus  a more  general  structure  than  parallel 
constraints.  The  theory  of  sections  T and  5 applies  to  an 
arbitrary  graph  of  constraints  on  S.  However  the  Garey  reduction 
algorithm  of  Section  5 applies  especially  well  to  finite  forests. 
Further  details  about  graph  theory  may  be  found  in  many  books,  for 
example  those  of  Berge  (1962,1970). 
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Search  Over  a partially  Ordered  Set 


In  this  section  we  prove  a theorem  about  the  optimal 
strategy  for  every  member  of  the  class  of  problems  introduced  in 
Section  2 under  arbitrary  partial  ordering  constraints.  Thus 
this  section  generalizes  the  main  result  of  Simon  and  Kadane  (1975) 
from  the  second  search  problem  to  the  entire  class. 

Before  stating  and  proving  the  theorem,  a few  lemmas  are 
necessary.  Let  S(a)  --  l+mG(a),  where  G is  defined  : n 2.^ 


Lemma  1 G(ab)  - G(ba)  and  S(ab)  = S( a)S(b) 

Proof 

G(ab)  = G(  a)  + [l  + mG(a)]G(b) 

= G(a)  + G(b)  4 mG(a)G(b) 

= G(b)  + [1 + mG ( b ) ) G ( a ) 

= G(ba) 

S(ab)  = 1 + mG(ab)  = 1 + mG(  a)  + m(Gb)  + m 20(  a)G(b)  = [l+mG(a)]  [l  + mG(b)] 

= S( a)S( b) . 


<s>.  E.  D. 


Lemma  2 : Then 


F(abcd)  - F(acbd)  = [l+mG(a)]  f f ( c )G(  b)  - f ( b)  G(  c ) 1 


Proof: 

F(abcd)  - F(acbd)  = F(abc)  + F(d)  + G( abc) f ( d)  - F( acb)  - F(d)  - G(acb) f ( d) 
= F(abc)  - F(acb) 

= F(  a)  + F(  be ) + G(  a)  f ( be)  -F(a)  -F(cb)  - G(a)f(cb) 


r 
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= F(  be)  - F'(cb)  + G(  a)  [ f ( be)  - f(cb)] 

= F(b)  + F(e)  +G(  b)  i'(  c ) - F(b)  - F(c)  - G(c)f(b) 

4-  G(a)[f(b)  + f(c)  + mG(b)l‘(c)  - t’(b)-f(c)  -mG(c)f(b)] 
= G(b)f(c)  - G(c)f(b)  + mG(a) [G(b)f(c)  - G(c)f(b)] 

= [1  + mG(  a)  ] [ G(  b)  f ( c ) -G(c)f(b)] 

Q.  E.  D. 


We  seek  to  minimize  F over  strategies.  Let  jz$(a)  = f(a)/G(a), 
where  a is  a strategy. 

A strategy  on  a set  o.t'  nodes  T is  any  ordering  of  the 
nodes  of  T that  satisfies  the  order  constraints  on  those  nodes.  Let 
A and  B be  two  mutually  exclusive  sets  of  nodes,  and  C their 
set  sum.  Then  A and  B are  interchangeable  iff  there  exist  a 
strategy  c = (ab)  and  a strategy  c'  = (b'a')  where  c and  c' 
are  strategies  on  C,  a and  a'  strategies  on  A and  b and  b' 

strategies  on  B.  If  A and  B are  interchangeable,  if  a is 

any  strategy  of  A and  if  b is  any  strategy  of  B,  then  (ab) 
and  (ba)  are  strategies  of  C. 

Theorem  j 

Suppose  G(a)  > 0 and  1 +mG(a)  > 0 for  all  a.  If 
b and  c are  interchangeable  in  (abed)  and  if  ^(c)  > jz^(b), 
then  (abed)  can  be  improved  by  interchanging  b and  c,  and 
hence  is  not  optimal. 

Proof: 

Using  Lemma  P, 

F(abcd)  - F(acbd)  = [1  + rnG( a)  ] { f ( c)G(  b)  - f ( b) G( c) } 

= [1  f mG(a)  ]G(b)G(c)[<rf(c)  - tf(b)]  >0 


Ki 
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Q.  E.  D. 
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Let  A be  a partially  ordered  art  ol  nodes,  and  let 
it  contain  B and  C » A - B.  HT  there  exist  strategies  b on  B 

and  c cn  C such  that  a - (be)  is  a strategy  on  A,  then  B is 

an  initial  subset  of  A and  C is  a terminal  subset  ol  A. 

A strategy  of  a set  of  nodes  D tor  which  j6  assumes 
its  greatest  value  over  strategies  on  D is  called  the  best  strategy 
on  D and  is  designated  t(D).  An  initial  set,  D ol  the  set 

T for  which  jrf(t(D))  is  maximal  over  all  initial  sets  of  T is 

called  a best  set  of  T. 

Theorem  4; 

Suppose  D is  a best  set  of  T.  Suppose  a is  an  arbitrary 
strategy  n T having  the  form  eh  where  e and  h are  strategies  on 
the  non-overlapping  sets  E and  H.  E and  H may  be  chosen  without 
loss  of  generality  so  that 

( i)  D c E 

(ii)  The  last  element  of  e is  a member  of  D.  Thus 

e consists  of  t(D)  possibly  interspersed  with  nodes 
of  T - D,  and  the  last  element  of  e is  a node  in  D. 

If  e contains  any  nodes  not  belonging  to  D,  then  e 

can  be  improved  (weakly)  by  moving  these  intruding  nodes  beyond  the 
last  node  of  D,  that  is,  by  bringing  the  nodes  of  D to  the  front  of 
e with  the  remaining  nodes  of  e following  them. 

If  D is  contained  in  no  best  set  of  T and  F(eh)  < 
then  the  improvement  above  is 


strict. 
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Lemma  5 Let  A and  AUB  be  initial  sets  of  T such  that: 

v 

(1)  A is  the  best  set  of  T,  with  best  strategy  _t(A)  = a and 

(2)  _b  is  any  strategy  for  B. 

Then  _>  s6{  b_) . 

If  AUB  is  not  a best  set  of  T,  then  jzf'  = <zS(a)  > (t(  ab) 

Proof: 

Since  A is  the  best  set  of  T,  - jz$(  a)  >_  «$(  ab) . 

If  AU  B is  not  a best  set  of  T,  then  j2  = jz$(a)  >gJ(ab) 

Now 

^(ab)G(ab)  = f(ab) 

- f(a)  + [1  + inG(a)  ] f(  b) 

- ^(a)G(a)  + [1 + mG(a) ]${ b)G( b) . 

But  G(ab)  jz5(a)  > G(ab)^(ab). 

Thus 

G(ab)  #5(a)  _>  <z!(a)G(  a)  + [1  + mG(  a)  ]0(  b) G( b) . 

• Expanding  the  left-hand  side, 

(G(a)  + [1  + mG(a)  ]G(  b) ) f6{a)  .>  a)G(a)  + [1  + mG(a)]  ^(b)G(b). 
i.e. , sz^v'a)  >.  jzf(b) . 

If  AUB  is  not  a best  set  c-f  T,  then  G(  ab)j^(  a)  > G(  ab)jz((  ab)  implies 
^(a)  > ^(b)  by  the  same  argument. 


Q.E.D. 


16. 

Lemma  4;  Let  _A  be  a set  consisting  of  the  mutually  exclusive 

subsets  of  nodes  B,  £,  and  I),  where  is  an  initial  bloc  of  A, 

while  _C  and  D are  interchangeable,  hence  also  both  terminal  blocs. 

v 

Let  the  best  strategy,  t.(A)  be: 

v 

t(A)  - ( b , , d^  , . . . , c^d^ ) . 

where  £ is  a strategy  for  H,  £ = ( c ^ , . . ■ , c,  ) is  a strategy  for 

_C  and  d_  - (d^ _0  :s  a strategy  for  D.  Then 

*z((c1 ) > ^(dx)  >.  . .h  /(£k)  £ 

Proof: 

""  v 

Suppose  0(d.)  < (c,  j).  Then  by  Lemma  2,  £(A)  could  be 

improved  by  exchanging  d.  and  £.  + ^.  contrary  to  the  hypothesis  that 
0(  A)  is  maximal.  But  the  exchange  is  admissible,  since  C and  D are 
exchangeable.  Similarly  th  ' s>'pp<>si  t'n  n that  0(c^)  < 0(d^)  leads  to 
a contradiction. 

Q.E.D. 

Lemma  5:  Given  A,  B,  £,  an:l  _D  as  in  Lemma  4,  with  £ = (£^ , . . . , £k) 
and  d - (d,  ,...,d.  ),  suppose  that.  A is  a best  set  of  T,  so  that 

v/  — K. 

V V v V , 

0(A)  = 0' . Then  ( i ) £ 0(A),  and  therefore  0(D)  > 0(A)  = 0'. 

Proof: 

f(o)  + b(e)f(dR) 

G( ,- ) e G(e)G(dk) 


Define 


c = • • •£;<)  • 


Then 


0'  0(ed.  ) 


rU*ik) 


Lemma  6;  Let  (a  c d)  and  (ac'd)  be  strategies  over  the  same 
set  of  nodes.  Then 

F(a  c d)  F(a  o'  d). 

Lf  c'  is  optimally  ordered  according  to  </: . 

Proof. 

By  repeated  application  of  Theorem  c. 


xi.  E.  D. 


mm  mmmsBsmm  S*reK5?PP?!P?FT,!,«is^T- 
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We  now  proceed  to  the  proof  of  Theorem  by  introducing 
some  new  notation.  Suppose  (a.,....ar)  and  (b1»---»br)  are 
strategies.  Then  let 

B1  = (b1...bi) 

C i = ( bpaib-^a2  * • • b ^a ] ) 


B,  - 


C1  * <bul°i+l’  ’ ,brar) 

V , , \ 

A.  = the  best  permutation  ot 

a!  . (k^o 

V .#.  . * / _ \ 

= the  best  permutation  oi  (, a j +1 ‘ * * r' 

* , v * . 

Ai  = (ai+lAi-l) 


For  consistency  define 

"0  = Cr  = A0  = Ar 
Designate  t(D)  by  A . and  e by  Cr> 


r _ p"  - 4 - a"  _ n b ••  A,  the  null  strategy, 

on  - u(j  r 


so  that  Br  is  a strategy 


on  the  intruding  nodes. 


:ie  strategy  on  T asserted  by  Theorem  jj 

oo  there 


to  be  an  improvement  over  eh  is  then  Ar^r!l‘  •*- 1 F(eh) 


is  nothing  to  prove.  Thus  to  prow  the  theorem  we  suppose 
F(eh)  = F(Crh)  < «>  and  must  snow 

F(Crh)  - F(ArBrn)  V 0 

Note  that  a' s may  be  moved  forward,  interchanging  them  with  b's, 
is  an  initial  bloc1  of  T. 

F(Crh)  - F(Arhrh)  -- 

F(Cr)  + F(h)  +G(t:r)f(h)  - F(ArBr)  -F(h)  - G(  A^)  f ( b) . 


since  D 


-’  -7T  ’A  +-fji  * »*¥¥*»: Jt*  tw» 
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Now  since  the  set  of  Cr  is  the  same  as  the  set  of  ArBr>  and  in  view 
of  Lemma  1, 


Then 


G(cr)  = G(Arbr) 


F(Crh)  - P(ArBrh)  - F(Cr)  -K(ArBr). 


Now  A^B^  = A qUq'  Also,  by  definition  of  D,  An  = An  . 


lO  O 


Then 


* * . 


F(Cr)  - F(ArRr)  = F(Cr)  - F(AnBn) 


0 0' 


r V*  * v-x  » 

= ^(ChA.B,)  - F(C._1A._.Bi_1)]. 

Considering  the  individual  terms  of  the  summation,  we  have: 


F(Cj 

v * 

, A.  , 

-i  1 -a 

* 

B.  . ) 

J — -L  * 

F(C: 

* 

* 

v * * 

, u . A . 
- !.  1 1 

-iV 

F(  C, 

* 

■X 

V*  * 

, b . A . 

- i ! 

-iV 

- HC^.b.A.^B.) 

v 

V*  * 

F(l!l 

. 1 1 . A . 
-1  : : 

-l,?i  ) 

1 ° - 

¥ * 
A. 

. - 1 ; 

_ v; 
> * 

V ¥ 

‘C:-l,;iA:-3  V ^ ° 

There fore. 


F(C.A. b, ) 

1 i- 

<2.  UC.^b. - H'O'i.jAr.jb.B*) 
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Applying  Lemma  P,  with  o 


-i-l  '' 


bL  b,  A,_1  - e,  K - _d. 


we  get. 


F ( 0 • A P . 1 - F{i:,A,  ,T'-  , ) 
v-  . 

> i\(  C . , . )o(b.)  - F(  b . ) o(  A;  1)],  whence 

- ! *“  J.  ‘ i — -i  L J . ^ 


v 


F(Cr)  - F(A0Bo)  _■  P 0(0._J0(i  ■.)G'va\_.  ->rf(b.)) 


1-1 


whe  re. 


T„  = 


r 

V 


1 . - 1U 


•3 \ 0 , , 'Jt(  b , ) J [ A.  ■ ) A ( A ..  . ) 


t2  - p ;:(r,  . )g(l..)c;(a  W{\>.) 

i=i 


Consider  . _A.  ^ 


s the  In.-.’t  ht. rut  eF;,  of  a terminal  bloc  of 


v 


Hence,  by  Lemma  h,  ?■( A 


<i  ' , :>o  t.  aal 


*1  - . 


e . .3 [ ..  . , )n(  b.  )'3\n: 


\ 


Next,  consider  T.  . imai.-rii.:-  o.(_p  “ ii(  ji;  )jS(  A.  ^ ) , 


above,  we  obtain. 


T.  = 


i 1 


• ) / ' ! ' • i • ■ i A ; _ J ) '3  ( A . _ -J  ) 


!?nce  u,  we  have  t/no  identity: 


s(a.  _1 'h;( Ai_1)  whov 


Zj  --  sU^i)  a* j_i ) - i3(Aj)G(A*t1) 

Us  Lng  this  ">  r.iation  hi  the  previous  one,  and  then  changing 
the  order  of  siaui.at  i on,  we  find. 


r r 


U1  J-. 


S(Ri_1)G(bj)o(ni)Z 


= h -‘Os 

J--1  - : 1 


7.  c.  r(fO 

n -*1  J 


,1  - i.  •’  •> 


But  B.  satisi’Io;'  too  eondi  tions  i f B of  Lemma  ‘j 
v J 

with  A as  A. 

~r 

Therefore,  by  that  lemma,  ^(h.)  . il-  nee, 

r 

T.s  s [ : L.G(!sO0' 

~ .•  4 .1  ,1 


< [ >.  >0  :•  go*.  , )h(  o. ) 1^' 

i - 1 a r . ' ‘ ~x  - 


r r , 

.;(  b.  , ) : . /: , o(  e.  ^ 

i t 1 “ 1 .*  l •’ 
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v 


< I S S(B1_1)G(b.)S(A1_1)G(A1_1)}r(' 


v 


< I S S(C,  i ) G ( b . ) G ( A . , )rf' 
1=1  w 


Comblning,  we  have  finally: 

V(cr)  - v(  A*B* ) 1 ^ - r, 

r v* 

2 - is^ci_1)G(b.)G(Ai_1)](^' -rf')  = 0. 

This  Is  the  result  we  want,  arid  tne  first  statement  in  the  theorem 
is  proved. 

Tf  D is  contained  in  no  best  net  of  T,  then  Lemma  3 

implies  • This  In  turn  implies 

r v + 

To  X >:  S(C,  ■ ) G ( b . ) G ( A . and  hence 

1*1  -_J-  - 

* # 

V(Cr)  - VIAqBq)  > T^  - T^  > 0,  which  concludes  the  proof  of  theorem  4. 

Q.E.D. 

Theorem  4 implies  the  following,  struct.ure  for  an  optimal  strategy: 

Let  be  a best  bloc  of  T,  and  a best  strategy  of  B^. 

Let  B2  be  a best  bloc  of  T - , and  o-,  the  best  strategy  of 

Bgj  . • • • Then  0 = (o^o0...).  Note  that  / ( !h  ) _>  )>.---  t 

by  construction. 

Corollary  1.  If  restrictions  of  the  type  ”b,  precedes  b,."  where  b4  eB., 

■ ' .]  1 1 

bj  c Bj  and  i < j ore  added  to  the  problem,  0 is  still  optimal. 
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3.  Garey  Reduction  Theorems 

In  a recent  paper  Garey  (Ly73)  gives  some  theorems  and  an 
algorithm  that  reduces  every  problem  that  has  a partial  ordering 
restriction,  and  finds  an  optimal  strategy  for  problems  where  the 
partial  ordering  graph  C has  an  immediate  graph  C that  tores 
a forest.  Garey' s results  were  proved  for  tine  second  example  oi  section 
The  purpose  of  this  section  is  to  show  that  Garey's  reduction  th  crems 
and  reduction  algorithm  apply  to  the  whole  class  of  problems  developed 
in  section  2. 

A search  is  called  terminal  iff  it  has  no  successors,  and 
initial  if  it  has  no  predecessors.  A search  s is  a maximal  successor 
of  search  s1  iff  it  is  an  immediate  successor  of  s1  and  satisfies, 
if  sJ  is  any  immediate  successor  of  s^,  ^(s)^^(s  ).  [For  readers 
comparing  this  treatment  with  Garey'..-,  note  that  Garey's  R satisfies 
R(s)  = - jzf(s).]  A search  is  a m L n i m a 1 pro  d c c .:scr  of  search  s 
iff  it  is  an  immediate  predecessor  and  satisfies,  if  s is  any 
immediate  predecessor  of  s^,  /(s')  > ^(s). 

Theorem  3:  For  any  problem  of  the  class  considered  here  that  has 

an  optimal  strategy,  let  t.  be  a nonterminal  search  having  only 
terminal  successors.  If  t.  is  a maximal  successor  oi  t ^ satisiying 
^(tj)  > frf(t^)  and  t.  has  no  other  immediate  predecessors,  then  there 
is  an  optimal  solution  in  which  trie  subsequence  t,t^  occurs. 
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Proof: 


Let  o bo  an  optimal  st. rategy • cf  necessity  t.  occurs 
somewhere  in  o,  and  each  of  the  successors  of  t.,  say  , 


including  t.  occur  in 
J 


o after  t..  Let,  without  loss  of  generality 

at  j 3i 


wne 


o - a0t..a1t1a2t2  . . . ~r-j~r+1 

re  eveiy  a.  except  possibly  a contains  no  successor 

K 1 r f -L 


of  tR.  Then  every  non-empty  aR,  except  ar+^  and  a^  is  inter- 
changeable with  tk  ^ and  tR.  Therefore,  using  the  optimality  of  o 
if  ak  is  non-empty  .>  0(aR)  > /( tR) . If  aR  is  empty, 

and  tR  are  exchangeable  and  again  by  the  optimality  of  o 
> rf(t k)  • 


Therefore 


^(tj)  > )6{o.r.)  ; 0(ti,)  j^(t.) 

-L  C_  c.  «J 


(where  empty  a^' s can  be  dropped  from  the  above  string  of  inequalities) 

Since  t.  is  maximal  among  successors  to  t., 

J ^ 

0(t  ) > (zHt,L), 

J *- 

so  equality  obtains  throughout  the  above  expression. 

o'  = a0tia1tjt1a2tg. . .arar+1 
is  a strategy,  and  Theorem  2 implies 

V(o)  = V(o'). 


Now  if  is  empty  the  theorem  is  proved. 


If  not,  it  is  exchangeable 


with  both  t.  and  t. 

i J 


Then 
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by  Theorem  2.  Now  szf(tj)  >.  by  assumption,  so  equality 

obtains  in  the  above.  Hence 

V(c)  = V(a0a1titJtJa2t^.  . . arar+1) 

and  the  theorem  is  proved  by  optimality  of  o. 

Q.  E.  D. 

Theorem  6:  Let  t.  be  a terminal  search  having  an  immediate 

J 

predecessor  t.  such  that  jZ$(t.)  > jrf(t.).  Consider  the  modified 

1 1 J 

problem  which  is  identical  to  the  given  problem  except  that  the 
constraint  graph  C of  the  modified  problem  is  formed  from  the 
original  constraint  graph  by  replacing  the  constraint  from  t^  to  tj 
by  a constraint  from  each  immediate  predecessor  of  t.  to  t..  Then 

-i-  J 

every  optimal  solution  to  the  modified  problem  is  also  an  optimal 
solution  to  the  original  problem. 

Proof: 

Let  o be  an  optimal  solution  to  the  modified  problem. 

Suppose  that  t.  preceeds  t.  in  o.  Then  we  can  write 

a - (aQtja^t^ay) , where  a^' s may  be  empty  for  i=0,l,2.  Suppose 

is  not  empty.  All  predecessors  of  tj  must  be  in  a^  since  o is 

a solution.  Hence  all  predecessors  of  t^  are  in  aQ,  also. 

Finally,  since  tj  is  terminal,  all  predecessors  of  are  in  a^. 

Hence  t.  and  a.  are  interchangeable,  and  a.  and  t.  are 
J -L  J.  1. 

interchangeable . Then 


^(tj)  > ^(ai)  > &(ti) . 


is  empty. 


If 


al 


t. . 
J 
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and  are  interchangeable,  leading  to 


^(tj)  > ^(t.) 

by  the  optimality  of  a.  But  these  inequalities  are  impossible  by 
the  assumption  of  the  theorem  that  frf(t.)  < j^(t.).  Hence  t, 
precedes  tj  in  o.  Hence  o is  also  a solution  to  the  original 
problem. 


Let  be  an  optimal  solution  to  the  original  problem. 

Since  the  original  problem  is  the  more  restricted. 


V(oR)  > V(o) . 

Then  V(o)  = V(aR)  and  a is  optimal  for  the  original  problem. 

Q.E.D. 

The  following  theorems  are  duals  to  theorems  5 and  6. 

Theorem  7:  For  any  problem  of  the  class  considered  here  which  has 

an  optimal  strategy,  let  tj  be  a non- initial  task  having  only 

initial  predecessors.  If  t.  is  a minimal  predecessor  of  t. 

r J 

satisfying  ^(t. ) < ^(t.)  and  t.  has  no  other  immediate  successors, 

J -L 

then  there  is  an  optimal  strategy  in  which  the  strategy  t.t.  occurs. 

J 

Theorem  8:  Let  t.  be  a terminal  search  having  an  immediate 

t J 

predecessor  t.  such  that  jz$(t.)  > ^(t.).  Consider  the  modified 
problem  which  is  identical  to  the  given  problem  except  that  the 
constraint  graph  C of  the  modified  problem  is  formed  from  the 
original  constraint  graph  by  replacing  the  constraint  that  t^ 
precede  tj  by  constraints  that  t^  precede  each  immediate  successor 


I ■««*>»  tiV  f'  -i 
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of  tj.  Then  every  optimal  solution  for  the  modified  problem  is  also 
a solution  to  the  original  problem. 

The  proofs  of  Theorems  7 and  8 are  the  same  as  those 
of  Theorems  5 and  6,  respectively,  with  the  sense  of  each  constraint 
reversed,  each  inequality  reversed,  and  each  strategy  reversed. 

Garey  then  proposes  the  following  reduction  algorithm. 

Algorithm  1. 

Step  (a)  Select  a connected  component,  containing  at  least 
one  constraint  from  the  current  reduced  precedence  graph.  If 
none  exists,  go  to  step  (i). 

Step  (b)  Depending  upon  whether  the  component  under  consideration 

has  no  multiple  immediate  predecessors  or  no  multiple  immediate 

successors,  go  to  either  step  (c)  or  step  (f),  respectively. 

Step  (c)  Choose  any  nonterminal  task  t?,  having  only  terminal 

immediate  successors,  from  the  current  reduced  version  of  the  component 

under  consideration.  If  no  such  task,  exists,  go  to  step  (a),  having 

completely  reduced  the  chosen  component 

Step  (d)  Find  a maximal  successor  of  t'.  If  jzKtl)  <^(t?), 

J 1 d 1 

go  to  step  (e).  Otherwise  reduce  the  component  by  deleting  tj  and 

the  constraint  from  t'.  to  t'. , and  replace  t'  by  a new  strategy 

J i 

[t^.tj].  If  the  new  task  is  terminal,  go  to  step  (c).  Otherwise  repeat 
step  (d). 

Step  (e)  For  each  immediate  successor  t^  of  t^,  replace  the 
constraint  t^  to  t^  by  a constraint  from  the  immediate  predecessor 
of  t^  to  t^.  Go  to  step  (c). 
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Step  (f)  Choose  any  non  Initial  task  t j , having  only  initial 

immeaiate  pi’edecessors,  from  the  current  reduced  version  of  the 

component  unde:  consideration.  If  no  such  task  exists,  go  to  step(a), 

having  completely  reduced  the  chosen  component. 

Step  (g)  Find  a minimal  predecessor  t'  of  t^.  If 

(rf(t')  < jrf(t^),  go  to  step  (h).  Otherwise  reduce  the  component  by 

deleting  t^  and  the  constraint  from  t!  to  t*.  by  a new  strategy 

[t^,t'].  If  the  new  strategy  is  initial  go  to  step  (f).  Otherwise 

repeat  step  (g)  with  [t^,tj]  acting  as  the  strategy  t*. 

Step  (h)  For  each  immediate  predecessor  t'  of  , replace 

k j 

the  arc  from  t^  to  t'.  by  an  arc  from  t^  to  the  immediate  successor 
of  tj.  Go  to  step  (f). 

Step  (i)  Let  t^, t^, . . • , denote  the  remaining  strategies  in 

the  completely  reduced  precedence  graph.  Order  them  as  t'  ,t!  , . . . , t' 

K1  k2  % 

so  that  f6(t ' ) > ),  for  all  i,  1 < i -c  m-1.  Removing  the 

Ki  “ Ki+1  “ ” 

brackets  from  this  sequence  results  in  an  optimal  solution  to  the 

original  problem. 

Garey's  algorithm  completely  reduces  a forest,  and  will  be  of 

benefit  in  an  arbitrary  partially  ordered  graph.  Garey  concludes 
his  investigation  by  saying  that  in  the  partially-ordered  case  "the  proper 
choice  may  depend  somehow  on  the  overall  likelihood  of  success  for  the 
complete  set  oi  tasks  or  certain  large  subsets  thereof,  a non-local 
property  which  may  be  difficult  to  use  in  an  efficient  algorithm." 

(Garey,  1973,  p.  95).  We  believe  that  Theorem  h is  the  nun-local 
theorem  sought  by  Garey.  It's  efficient  use  in  algorithms  depends  on 
the  exploitation  of  special  structure  to  reduce  the  number  of  sets  ever 
which  the  best  set  of  T must  be  searched  for. 
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imposed  in  Kadane  (1968),  that  p. , be  non-increasing  in  j 

_ 

• CU 

for  each  i,  is  thus  seen  to  be  the  condition  that  each  best  bloc 
consist  of  only  a single  element. 

In  this  sense  Theorem  4 generalizes  the  result  proposed, 
but  not  proved,  in  Kadane  (1968). 
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